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Abstract. We study the asymptotic behaviour, as time variable t goes to -\-oo, of nonautonomous dynamical systems 
involving multiscale features. As a benchmark case, given TC a general Hilbert space, $ : Ti RU{+oo} and 
: H — > R U {+00} two closed convex functions, and f3 a function of t which tends to +00 as t goes to +00, we 
consider the differential inclusion 

x(t) + d'S>{x{t)) + (3{t)d'i'{x{t)) 3 0. 
This system models the emergence of various collective behaviors in game theory, as well as the asymptotic control of 
coupled systems. We show several results ranging from weak ergodic to strong convergence of the trajectories. As a 
key ingredient we assume that, for every p belonging to the range of Nc 

where is the Fenchel conjugate of ac is the support function of C argmin'J' and Nc{x) is the normal cone to 
C at x. As a by-product, we revisit the sytem 

i(t) + e{t)d^{x{t)) + 9^'(a;(t)) 3 

where e(t) tends to zero as t goes to +00 and J(^°° e{t)dt — +00, whose asymptotic behaviour can be derived from 
the preceding one by time rescaling. Applications are given in game theory, optimal control, variational problems and 
PDE's. 
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1. Introduction 

H is a real Hilbert space, we write = {x,x) for x & H. We denote by ToCH) the class of closed (lower semi- 
continuous) convex proper functions from 7i to RU {-|-cxd} which are not identically equal to +00. The subdifferential 
of / £ ro(?i) is the maximal monotone operator 

df-.n 2^ 

X ^ {ueHHyyen) fiy)>f{x) + {u,y-x)}. 

1.1. Problem statement. 

• $ : 7i ^ R U {+00} is a closed convex proper function. 

• : H ^ U {+00} is a closed convex proper function, C = argmin^f = ^'"^(0) 7^ 0. 

• (3 : M+ R+ is a function of t which tends to +00 as t goes to +00. 

We study the asymptotic behavior of the trajectories of the nonautonomous multiscaled differential inclusion 

(1) (MAG) x{t) + d<^{x{t)) + p{t)d'i>{x{t))BQ 
where 9$ and are the subdifferentials of <i> and 5*. 

Let us observe that 9$ + f3{t)d'^ C (9($ + /3(t)5') (equality holds under some general qualification assumption). 
Hence, each trajectory of [MAG) satisfies 

i(<) + 9($ + /3(i)*) {x{t)) 9 0. 

On the other hand, $ + I3{t)'^ ] ^ + 5c as t — » +00 where 5c is the indicator function of the set C {5c{x) = 
for X £ C, +00 outwards). Monotone convergence is a variational convergence, ([IJ, theorem 3.20). As a consequence, 
the corresponding subdifferential operators converge in the sense of graphs (equivalently in the sense of resolvents) as 
t +CXD (T, theorem 3.66) 

5($ + /3(t)*) ^9($ + (5c). 

From the asymptotical point of view, this suggests strong analogies between {MAG) and the steepest descent 
dynamical system associated to the closed convex proper function $ + (^c G Tq{1-C) 

(2) x{t)+d{^ + 5c){x{t))^Q. 

In our main result, theorem 3.1, we prove that the two systems ^ and ^ share similar asymptotical properties, 
whence the terminology {MAG)= "Multiscale Asymptotic Gradient" system. 

More precisely, under general assumptions, we prove that each trajectory of {MAG) weakly converges in 7i, with 
its limit belonging to argmin^^ 

(3) x{t) Xoo G argminp$ as i — > +00. 

This result can be seen as an extension of Bruck's theorem [15] to multiscaled nonautonomous gradient systems. 

1.2. Notion of solution. We consider strong solutions in the sense of Brezis ([H], definition 3.1). Such a solution x{.) 
is continuous on [0, +00) and absolutely continuous on any bounded interval [0, T] with T < +00. Being absolutely 
continuous, x{.) is almost everywhere differentiable, and it it assumed that the equation holds almost everywhere. 
Equivalently x{.) is a solution of {AIAG) if there exist two functions £,{.) and r]{.) with 

^{t) e d^{x{t)) and ri{t) G d^{x{t)) for almost every < > 

such that 

x{t) + m + mvit) ^ 0. 

In particular, x{t) G dom{d^) n dom{d'^) for almost every i > 0. 

Existence of strong solutions of nonautonomous monotone differential inclusions is a nontrivial topic. This question 
is not examined in this paper. We take for granted the existence of such trajectories. The interested reader can consult 
Brezis [12], Attouch-Damlamian [2], Kenmochi 19J for precise conditions insuring the existence of such solutions. In 
this paper, we shall be concerned only with the asymptotic behavior of the trajectories of the above systems. 
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1.3. Key assumption. We shall prove the convergence property ([3]) under the assumption 

(Hi) VpeRiNc) / m 
In (Til) we use classical notions and notations from convex analysis: ^* is the Fenchel conjugate of 

and ac is the support function of C = argmin^ 

yyen ac{y) = sup {y,x). 

xec 

Note that ac is equal to the Fenchel conjugate of Sq, where 6c is the indicator function of C. Nc{x) is the (outwards) 
normal cone to C at x. We denote by R{Nc) the range of Nc, i.e., p £ R{Nc) iff p G Nc{x) for some a; e C. 

Analysis of the condition (Hi): 

• a) Note that "if enters in {MAG) only via its subdifferential. Thus it is not a restriction to assume minn^ = 0. 
For a function 5* whose minimum is not equal to zero, one should replace in (Tii) and in the corresponding 
statements ^E* by — min-u'^- 

From 5* < (5(7 we get ^E** > (Sc)* = cc and — ac > 0. (Hi) means that the nonnegative function 



t ^ f3{t) 



is integrable on (0, +oo). It is a growth condition on /?(.) at infinity which depends only on '5. 

• b) As an illustration, consider the model situation: ^'(z) = ^dist'^ {z , C) — ■^\\-\\^ +e Sc, where 
the epigraphical sum (also called inf- convolution) . From general properties of Fenchel transform 

**(z) = + ac{z) and **(z) - ac{z) - ^\\z\\\ 

Hence, in this situation 



denotes 



+ 00 ^ 



which is satisfied for example with /3(t) = (1 + t)P, p > 1. 



1.4. Contents. Several results concerning the asymptotic convergence analysis hold true in respect of the more general 
differential inclusion 



(4) x{t) + A{x{t)) + I3{t)d^{xit)) 3 

with A maximal monotone operator (in particular one may consider A = 9$), and without regularity assumptions 
on the function /?(.) which may present oscillations, discontinuities. In section 2, we prove an ergodic convergence 
result (theorem 2.1) which holds for ([4]), and which extends Baillon-Brezis theorem [10] to a nonautonomous multiscale 
setting. 

In section 3, we return to (MAG) system with A ~ 9$. By using energetic Liapunov methods, under the additional 
growth condition on /3, namely /3 < fc/3, we prove an asymptotic weak convergence result (theorem 3.1). This result 
can be seen as an extension of Bruck theorem ([K|). In section 4, we revisit the asymptotic analysis of the sytem 



(5) xit) + e{t)d^{x{t))+d^{x{t))3 

where e{t) tends to zero as t goes to +oo and satisfies J^°° e{t)dt — +oo. Indeed (O can be derived from {MAG) by 
time rescaling. In section 5, we show that, in the particular case of inf-compact functions (in particular in the finite 
dimensional case), convergence results of section 3 hold without growth condition j3 < kj3 . 

In last section 6, applications are given to coupled gradient dynamics. In particular, we consider domain decompo- 
sition for elliptic PDE's, and best response dynamical approach to Nash equilibria for potential games. 
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2. With a maximal monotone operator: ergodic convergence results 
In this section, we consider the differential inclusion H]) with a maximal monotone operator A. We call it {MAM I): 

{MAMI) x{t) + A{x{t)) + I3{t)d'^{x{t)) 3 0. 
This terminology stands for "Multiscale Asymptotic Monotone Inclusion" with a justification similar to (MAG): 
one expects that the nonautonomous multiscale differential inclusion [MAMI) enjoy asymptotic properties similar to 
the autonomous monotone inclusion 



x{t) + {A + Nc){x{t)) 9 0. 

We denote by S the set of equilibria S := {A + Nc)^^{0). They are solutions of the monotone variational inequality 

A{x)+Nc{x) 3 0. 

We first examine (MAMI) with a general maximal monotone operator A, in which case we prove an ergodic 
convergence result. Then, in the particular case of a strongly monotone operator A, we prove strong convergence of 
the trajectories towards the unique equilibrium. 

Theorem 2.1. Let 

• A : Ti. ^ 2^ be a general maximal monotone operator. 

• 4* : 7i ^ R+ U {+00} be a closed convex proper function, such that C = argmin^ — ^'^^(0) 7^ 0. 
Let us assume that, 

(Ti-a) A + Nc is a maximal monotone operator and S := {A + Nc)~^{0) is non empty. 



[Hi) VpeR{Nc), / Pit) 



dt < +00. 



Then, for every strong solution trajectory x{.) of the differential inclusion (MAMI): 

1 /•* 

(i) (weak ergodic convergence) 3xoo € S such that w— lim — / x{s)d. 

+ t Jq 

[ii) \fz e S, lim \\x{t) — z\\ exists; 

t — y-\-oo 

p + 00 

(Hi) (estimation) / f]{t)'^{x{t))dt < +00. 



By taking 5* = in Theorem 12. 11 we recover the Baillon-Brezis result on the ergodic convergence of semi- groups of 
contractions in Hilbert spaces (generated by maximal monotone operators). 

Corollary 2.1. [10, Baillon-Brezis] Let A : Ti. ^ 2^ be a maximal monotone operator such that A~^0 7^ 0. Let x be 
a .strong solution of 

xit)+A{x{t)) 3 0. 

Then, 



If 

lim — / x{s)ds — Xao exists with Xoc G A ^0. 

-^ + 00 t Jq 



t^ + oo t 

Remark 2.1. An elementary example (take A equal to the rotation of angle ^ in R^) shows that ergodic convergence 
can happen without convergence. Clearly, the same holds true for (MAMI). 

2.1. Proof of Theorem 12.11 It relies on an Opial type argument. Owing to the length of the proof, we decompose 
it in several lemmas. 

Lemma 2.1. For every z e S = {A + Nc)~^{0), linit^^oo \\ x{t) — z \\ exists. 
Proof of Lemma 12.11 Set 

h.{t) = \\\ <t)-zf 
and compute the time derivative of h^it). For almost every t > 

h,{t) = {x{t)~z,x{t)) 

= {x{t)^z,-at)-mv{t)), 

where, by definition of x{.) solution of (MAMI), 

x(t) + at) + mvit) = 

with 

C(i) e A(x(t)) and ri(t) e d^(x(t)). 
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Equivalently, 

(6) kit) + (^(t), x{t) -z)+ mivit), x{t) - z) = 0. 

Since z G 5 C C and ri{t) e 9^'(a;(t)), we have 



that is, 



(7) 



= ^{z)>^(x{t)) + {Tj{t),z-x{t)), 



Since z G S, we have Az + Nc{z) 3 i.e., there exists some p £ Nc{z) such that —p G Az. By monotonicity of A 
and ^{t) G A{x(t)) 

(8) {C(0,2:(i)-z)>(-p,x(t)-z). 
In view of (O, ([7]) and ([5]), and since /3{t) > we obtain 



Let us rewrite this inequahty as 



(9) 



,x{t)-z)--i>{x{t)) 



Since we have no prior information on x{t), let us take the supremum of this last expression with respect to x 



h,(t) < Pit) 



which makes appear the Fenchel conjugate of namely 4**, and gives 



(10) KM<m[^*{^)-{^y^ 

Let us now examine the term {-j^i z) in (jlOp . Since z G C and p G Nc{z) we have 

Va; G C {p,x~ z) <0 

which implies 



(p, z) = sup(p, = ac{p). 

xec 



By positive homogeneity of ac and P{t) > 0, we obtain 



(11) 



Collecting (|10[ [TT|) we finally obtain 



(12) 



kit) < m 



-(m)--(m) 



Note that < Sc, hence ** > ac and - fic > 0. 

It follows from (fT2|) and assumption (Hi) that (/i2)_|_ G L^(0,+oo), which classically implies that \mit^+oohz{t) 
exists in R.D 



Lemma 2.2. For each t > set 



Every weak limit point of X{.) belongs to S. 



X{t) = - / x{s)ds. 
t Jo 
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Proof of Lemma 12.21 Let t„ — > +c>o and suppose X{tn) ^ X^o (weak convergence in H). Take an arbitrary 
z G C n domA , and y G (A + Nc){z). Consider again the function hz{t) — \ \\ x{t) — z p. Recall ([6]): 

k{t) + x{t) -z)+ (3{t){r]{t), x{t) - z) = 0. 
For some p G Nc{z), y — p ^ ^{z)- By monotonicity of A and ^{t) G A{x{t)) 



Recall © 



and we obtain 



Hence 



{at),x{t)-z)>{y~p,x{t)-z). 
{V{t),x{t)-z)>-^{x{t)) 

K{t) + {y,x{t)-z) <(3{t) 



^^,:r(t)-z)-*(xW) 



K{t) + {y,x{t)~z)<l3{t) 



Let us integrate from to t 



h,{t) + [y,J x{s)ds-tzj <KXO)+ J p{s) 
After division by t, and taking account of hz > 0, one obtains 



Pis) 



ds. 



{y,X{t)-z) < ^hM + ^ I m 



(3{s) 



ds 



1 1 



(3{s) 



ds 



< 



where 



c:=hz{0) + 



-\-oo 



vl/* 



(3{s) 



ds, 



is, by assumption (TYi), a finite positive number. 

Recall that t„ — > +oo and X(tn) X^o (weak convergence in Ti). Passing to the limit as n 



'Oo on 



we finally obtain 



An equivalent formulation is 



{y,Xitn)~z} < - 



{y,Xoo-z) < 0. 



{0-y,Xoo~z) > 0. 

The inequality being true for any y G dom(A + Nc) and any y £ [A + Nc)z, by maximal monotonicity of the 
operator A + Nc (Assumption (Hq)), we obtain G (^ + Nc){Xoo), that is X^o E S.O 

Just like in Passty [3T], we conclude to the ergodic convergence of the trajectories thanks to Lemmas 12.11 and 12.21 
and the following ergodic variant of Opial's lemma [20] , 

Lemma 2.3. Let TL be a Hilhert space, S a non empty subset ofH and x : [0,+oo) Ti a map. Set 



X{i) 



x{s)ds 



and assume that 



(i) for every z £ S, lim || x(t) — z \\ exists; 

t — *+oc 

(ii) every weak limit point of the map X belongs to S. 
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Then 

w — lim X{t) = Xoo for some element X^o G S. 

t — *+oo 

Proof of Lemma l2.3l First note that x is bounded (from («)), thus X also and it is sufficient to prove uniqueness 
of weak hmit points. Let X{tn-^) Xoo,i and X(<„2) Xoo,i be two weak converging subsequences. 
Let us prove that Xoo.i — Xoo,2- By {ii), Xoo.i and Xoo, 2 belong to S. Hence, by (i), linit^+oo || x{t) — Xoo.i |P and 
limt^+00 II x{t) — Xoo,2 IP exist. As a consequence, the following limit exist 

limi^+00 [II Xit) - Xoo,l IP - II Xit) - Xoo,2 IP] . 

After simplification 

lim {x{t),Xoo,2 ~ Xoo,i) exists. 

t — * + Ctt 

As a general classical result (Cesaro), convergence implies ergodic convergence. Hence 

lim {X{t),Xoo.2 - Xoo,i) exists. 
t — '+00 

In particular, 



lim {X {tni),X 00,2 - Xoo, 1) ^ lim (X(t„ J, Xoo,2 - ^00,1), 

in^ — > + 00 tn^ — ^ + 00 



that is 



and II Xoo. 2 — Xoo.i |P= 0, which ends the proof of the lemma. □ 



End of the proof of theorem \2.1\ 

Let us complete the proof of theorem 12.11 and prove the estimation 



+00 



I3{t)-^{x{t))dt < 



Let us return to 



K{t) < Pit) 

which can be written in a splitted form as 



h.it)^m^ixit))<m 



By using a device similar to the proof of lemma 12.1 



< M 
2 



*(a;) 



/ 2p_ 



Let us integrate this last inequality from to r 



(13) 



K{r) - hM +1 r pmix{t))dt < i m 



* Km) ""^'ymj 



dt. 



By assumption (Tii), the second member of (|13p is a finite quantity (note that p G R{Nc) implies 2p G R{Nc))- 
This being true for any t > 0, we finally obtain 



+00 



/3{t)^{x{t))dt < 
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2.2. The case A strongly monotone. The argument developed in the preceding section allows to conclude to 
convergence of the trajectories when the operator A : H ^ H satisfies a strong monotonicity property. We recall that 
A is said to be strongly monotone if there exists some a > such that for any x £ domA, y € domA and any ^ S Ax, 

{£, - r],x - y) > a \\ X - y . 

Theorem 2.2. Let us assume that, 

• {Ti-o) A + Nc is a maximal monotone operator and S := {A + Nc)~^{0) is non empty. 

VpeRiNc) £^Pit)[^*{^-J^)-.c{^)]dt<+oo. 

• (7^2) A is a strongly monotone operator. 

Then, there exists a unique equilibrium x, i.,e., S = {x} with Ax + Nc(x) 3 and any strong solution trajectory 
x{.) of the differential inclusion [MAMI) strongly converges to x as t ^ +00: 



s — limt^^oo x{t) = X. 

Proof of Theorem 12.21 By strong monotonicity of A, the operator A + Nc is also strongly monotone. As a 
consequence, there exists a unique solution x to the inclusion 

Ax + Nc{x) 3 
and there exists some p G Nc'{x) such that Ax 3 —p. 
Let us return to ([6|), with z = x and hx{t) = h W ^{t) ~ ^ Ip! 



(14) 



MO + i^it), x{t) ~x)+ I3{t){r]{t), x{t) - x) - 0. 



Let us rewrite (fT4l) as 



hxit) + {m - (-p), x{t) -x)- {p, x{t) ~x)+ p{t){r]{t), x{t) - x) = 0, 
and use the strong monotonicity of A together with ^{t) G A{x{t)) to obtain, for some a > 0, 

h^{t) + a II x{t) - X f ~{p, x{t) -x)+ (3{t)(r]{t), x{t) - x) < 0. 
By using the convex subdifferential inequality 



we deduce 



Hence, 



{) = ^{x)> + {r]{t),x ~ x{t)) 



h^{t) + a II x{t) - X f -{p, x{t) -x)+ (3{t)^{x{t)) < 0. 



h-{t)+a\\x{t)-x\\^<p(t) 
By using a device similar to theorem 12. II 

h^{t)+a II x{t) - X f < P{t) 
After integration of this inequality from to t, 



l^^^,x{t)-x)-^{x{t)) 



t /' + OC 

h^{t)+a I \\x{s)-xf ds<h^{0)+ (3{s) 



Pis) 



by using assumption (Tii), one obtains 



ds, 



II x{t) -X IP dt < +00. 

On the other hand, by theorem 12. 11 limt^_|_oo || x{t) — a: || exists. As a consequence, this limit is equal to zero, i.e. 
limt^+00 II x{t) —x\\=0, which ends the proof of theorem 12.21 □ 
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3. The subdifferential case: weak convergence results 
In this section, we consider the dynamical system 

{MAG) i{t) + d<^{x{t)) + (3{t)d'if{x{t)) 3 0. 
When = 0, (MAG) boils down to the classical steepest descent differential inclusion 

x{t) + d<^>{x{t)) 3 0, 

studied by Brezis [12] [13], Bruck [15] and Baillon [9]. In accordance with these studies, in our main result, we are 
going to show that each trajectory of (MAG) weakly convergences to a minimizer of ^P, which also minimizes $ over 
all minima of 4". 

Before stating our result precisely, let us specify the notion of solution. We recall that a solution x{.) of (MAG) 
is continuous on [0, +oo), absolutely continuous on any bounded interval [0,T] with T < +cx), and it it assumed that 
the equation holds almost everywhere. Moreover, in this section, we will assume that there exist two functions ^(.) 
and ?7(.) which are integrable on any bounded interval [0, T] and such that 

(15) x{t) + at) + mvit) = 

with 

(16) ^t) e d<^{x{t)) and r]{t) e 9^'(a;(i)) for almost every t > 0. 

In several cases, for example if is differentiable, with a Lipschitz gradient V^* on the bounded sets, or if the 
subdifferentials 9$ and 9^ satisfy an angle condition, the assumption that the two functions ^(.) and '/]{.) are locally 
integrable is automatically fulfilled, provided that the trajectory x is absolutely continuous. However, in general, it is 
a nontrivial issue for which we refer to Attouch-Damlamian [2]. We will denote by S" = argmin{<I>|argmin\E'} the set 
of equilibria, which is a dense notation for S ~ {z ^ argmin^* : $(2) < $(a;) for all x £ argmin^E'}. 

Theorem 3.1. Let 

• :TC ^ K+ U {+C!o} be a closed convex proper function, such that C = argmin^ = ^'^^(0) ^ 0. 

• $ : 7i ^ M U {+00} be a closed convex proper function, such that S = argmin{'^\argmin'^} ^ 0. 

Let us assume that, 

^+00 



dt < 



-00. 



(7^2) P ■ is a function of class , such that linit^+oo P{t) — +00, and for some k > and to > 

< Pit) < k(3{t) for all t>ta. 

Let X be a strong solution of (MAG) . Then: 

(i) weak convergence 3xoo S — argmin{^\argmin^}, w — lim x{t) = Xoo] 

t — *+oo 

(a) minimizing properties lim ^(a;(t)) = 0; 

t — >-\-oc 

^ hm^$(x(t)) = min$|a^^^j„^; 

(Hi) \/z E S lim \\x{t) — z\\ exists ; 

t — ^+00 

(iw) estimations lim (3{t)'i/{x(t)) = 0; 

t — *+oc 



+00 

(3{t)'^{x{t))dt < +00; 



limsup / $(x(t)) — min<I>|g™^j^^(ii < +00. 
Jo ^ 

By taking = in Theorem 13. li we recover the convergence result of Bruck on the steepest descent method. 

Corollary 3.1. 15, Bruck, Theorem 4] Let $ : ?i — > R+ U {+cxd} be a closed convex proper function, such that 
argmin^ ^ 0. Let x be a strong solution of 

(SD) x{t) + d<^{x{t)) 3 0. 
Then x weakly converges to a point in argmin^. 

Remark 3.1. The counterexample of Baillon [9 shows that one may not have strong convergence for (SD). Of course, 
the same holds for (MAG). 
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Proof of Theorem 13.11 As in Bruck [T3] , the weak convergence is consequence of Opial's lemma, after showing 
the convergence of ||a;(.) — z\\ for every z G S, and that every weak hmit point of x belongs to S. The proof is not 
short, and we decompose it in several lemmas. For an element z G 5 = argmin{$[argmin^'}, we define the function 

/i^ : M+ ^ R+ by 

h^it) = l\\xit)-zr. 

We give the estimations on the function h^, that we will use in the proof. Compute the derivative of and use 
the system equation {MAG), ^5)1 and for a.e. t: 

h,{t) = {i{t),x{t) ~ z) 

with ^(i) e d^{x{t)) and r]{t) e d'9{x{t)). Thus, using z G argmin^f, 

Hz) > <P{x{t)) + m,z-xit)); 
= *(z) > -iiixit)) + {T]{t),z -x{t)). 

We deduce (note that (3{t) > 0) 

L{t) + $(a;(t)) - Hz) + f3{t)^{x{t)) < 0. 
Since z € S = argmin{$|argmin5'}, write the first order necessary condition (with C = argmin\l/) 

e a$(z) + Nc{z), 
and there exists p £ Nc{z) such that —p G 9$(z). Thus 

Hx{t)) > ^{z) + {-p, x{t) - z) 

and 

(17) h,{t) + (3{t)-i'{x{t)) + {-p, x{t) -z)< h,{t) + $(a;(t)) - $(z) + P{t)^{x{t)) < 0. 

Lemma 3.1. For every z £ S, as t ^ +oo, 

• (i) \\x{t) — z\\ converges in M; 

• (ii) i 1-^ /q $(a;(s)) — <i>(z) + P{s)'if{x{s))ds converges in R; 

• (Hi) J^{p,x{s) — z)ds converges in R; 

• (iv) Moreover, J^°° P(t)^>{x{t))dt < +oo. 

Proof of Lemma 13. 11 Parts (i) and (iv) were already proved in Section 2. However, they are obtained easily with 
the others, which permits an easier reading. Recall that, by definition of the Fenchel conjugate of ^P, 



and that z G C and p G Nc{z) imply 
thus, in view of (fTTl) 

hAt) + m + ) < kit) + f^mi^t)) + i-p, x{t) - z) < 0. 

From Assumption (Tii), by integrating the above equation between two large enough real numbers, we first deduce 
that the function hz satisfies the Cauchy criterion, and is bounded, thus converges in M, that's (z). Then we deduce 
the convergence of the function 

t ^ / [3{s)^{x{s)) + {-p, x{s) - z)ds, 



and, in view of (jl7p . of the function 



/ ^{x{s)) ~Hz) + f3{s)-i'{x{s))ds, 







that's {ii). Since ^' > 0, and in view of ^T7\ . 

hz{t) + ^■^{x{t)) + {-p, x{t) -z)< hz{t) + m-^{x{t)) + {-p,x{t) -z)<0. 

As ^ G Nc{z), 

h.{t) + ^ (^) +-C (^)) < k{t) + ^HMt)) + {-PMt) -z)<o, 
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which, in view of (Hi), imphes the convergence of 



Jo 2 

From (ii) we deduce that 

^+00 

l3{t)^{x{t))dt < +00, 

and that 1 1-^ J*{p,x{s) — z)ds converges in R, these are respectively {iv) and {Hi). 

Let us recall and translate a lemma from Brezis '12', in the special case of the subdifferential of a convex function: 

Lemma 3.2. [T^l Lemme 4, p73] Let $ : 7i — > M U {+00} he a closed convex proper function. Let x G iv^(0, T; H) 
he such that x G L^(0,T; H) and x{t) G Dom(d^) a.e. t. Assume that there exists ^ G L^{0,T; H) such that ^(t) G 
d^{x{t)) for a.e. t. Then the function t ^ ^{x{t)) is ahsolutely continuous and for every t such that x{t) ^ Dom{d^), 
X and are dijjerentiahle at t, we have 

yhed^xit)), j^^{x{t))^{x{t),h). 

Lemma 3.3. Let 

Then the function Ei is absolutely continuous, and, for a.e. t. 

The function E\ converges to zero, and linii^+oo ^(^^(i)) = 0. 

Proof of Lemma 13.31 From Lemma [321 the functions t t-^ ^{x{t)) and t t-> ^{x{t)) are absolutely continuous, 
and for a.e. t, 

j^Hxit)) = m,m) 

Thus the function Ei is absolutely continuous (recall that P is of class C^) and, by using (|15p . for a.e. t, 

By Lemma |3.1[ the trajectory x is bounded. Write, for example, 

$(x(t)) > $(z) + {-p, x - z), 
to see that ^{x{t)) is bounded from below. By Assumption (7^2), the function [3 is non decreasing. Hence 

which implies the convergence of the function Ei, recalling that limj^+oo f3{t) — +00. From Lemma |3. 11 (m), we have 

liminf ^{x{t)) - $(z) + /3(i)*(x(i)) < 0. 

t — >+oc 

Using that ^{x{t)) is bounded from below and that '^{x{t)) > 0, we see that the above lower limit belongs to M. As 
a consequence, we can take a sequence (t„) which tends to +00 such that <i>(x(t„)) — $(z) + /3(i„)\E'(x(t„)) converges, 
and obtain 

hm E,{t)= hm i?i(t„)= lim (<I>(x(t„)) - $(z) + /?(t„)vl/(x(t„))) + -1^$(^) = 0. 

t^+oo ri-»+oo p(tn) P(tn) 

Write 

< vl'(a;(t)) < vl/(x(t)) + ($(x(i)) - inf $(x(s))j = E,{t) - ^ M^x{s)) 



to deduce 



lim ^'(a;(t)) = 0. 

i — >-+oo 
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Lemma 3.4. 



lmimf(—p,x{t) — z) = 0; 
liminf > <^{z). 

t — )-+oo 



Proof of Lemma 13.41 Since 1 1-^ (p, x{s) — z)ds converges in R (Lemma 13.1 

li 

t 

Now take a sequence (t„), i„ — > +00, such that 



hminf (— p, — z) < 0. 



Hm {—p,x{tn) — z) — I 

n — *+oo 

for some I G M. Since the trajectory x is bounded, and up to a subsequence, 
for some Xoc G ^ • Then 

Um (p, a;(t„) - z) = (p, Xoo - z). 

n — *+oo 

By weak lower semicontinuity of the function 5* 

^(xoo) <hminf«'(a;(<„)) ==0 

n — ^+00 

thus 

Xoo G argmin\l/. 

Sincere ^argmin*(^)' 

(-p, Xoo - z) >0. 
Thus, every limit point of {—p,x{t) — z) is nonnegative, that is 

liminf (— p, a;(i) — 2) > 0. 

t — >+oo 

Now, for every t, since — p e 

$(x(<)) >$(2) + (-p,a;(i)-z), 

hence 

liminf > $(z). 

t — )-+oo 

Lemma 3.5. Let 

E2{t) ^ ^x{t)) + I3{t)-^{x{t)). 

a) The function E2 is absolutely continuous, and, for a.e. t, 

E2{t)^-\m?+Km{<t))- 

b) The function E2 converges, linit^+oo '^{^{t)) = ^{z), o,nd limt^+00 f3{t)'i'(x{t)) — 0. 

Proof of Lemma 13.51 See the proof of Lemma [3.31 for the proof of part a). Since J^°° f3{t)'^{x{t))dt < +00 
f Lemma 13.11) and $ < kf] (Assumption (7^2)), then J^°° ${t)'i'{x{t))dt < +00, which implies the convergence of the 
function £2- By Lemma l3. 11 (ii). 



thus 
Hence 

Since fLemma [3.41) 

we deduce 

and 



hm / $(a;(s)) - <i>(z) + f3{s)'^{x{s))ds exists in 



hm E2{t)= hm $(a:(i)) + /3(t)^'(a;(t)) = $(2). 

t — *+oo t— »+oo 



hmsup$(a;(t)) < hm <^{x{t)) + I3{t)^{x{t)) < <P{z). 



liminf $(2:(i)) > $(2), 

t — >- + oo 



lim ^{x{t)) = 



hm /3(t)*(a;(t)) = 0. 

t — *+oo 



In view of Opial's lemma, since we aheady proved the convergence of \\x{t) — z\\ for every z £ S = argmin<i>, the 
proof of Theorem 13.11 is finished with the foUowing lemma. 



Lemma 3.6. If x{tn) x^o, then Xoo £ S = argmin{^\argmin^} . 
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Proof of Lemma 13.61 By weak lower semicontinuity of the functions $ and ^E" 
^(a^oo) < limini 'i>{x{tn)) = thus Xqo G argmin^. 



n — *+oo 



^{xoo) < hminf $(a;(t„)) = $(z) thus G argmin{$|argmin4'}. 

n — >+oo 

4. MULTISCALE ASPECTS 

In this section, we show that the system (where (3{t) — ^ +oo as t ^ +oo) 

(MAG) x{t) + d<^{x{t)) + P{t)d^{x{t)) 9 0, 

after time rescahng, can be equivalently rewritten as 

{MAG)e x{t) + d^{x{t)) + e{t)d^{x{t)) 9 0, 

with a positive control t i—t e{t) that converges to as i ^ cxd. 

By taking <i>(a;) ~ ||x|p/2, {MAG)^ system amounts to the {SDG)e system (steepest descent with control) 

(SDC)^ x{t) + 9*(a;(t)) + e{t)x{t) 3 0. 

The {SDC)e system plays an important role in optimization and game theory as well as in asymptotic control 
theory and the study of ill-posed problems. It can be viewed as a Tikhonov-like dynamical system. In the particular 
setting of {SDC)e, the asymptotic convergence properties of the trajectories depend on whether e(-) is in L^{0, oo) or 
not. 

For the case e(-) ^ L^, the first general convergence results go back to P3] (based on previous work by [H]) and 
require in addition e(-) to be non-increasing. Under these conditions, each trajectory of {SDC)e converges strongly 
to x, the point of minimal norm in argmin^*. This case is often referred to as the slow parametrization case (slow 
convergence of £(•) to zero). In a recent contribution to this subject |16j . it is proved that this convergence result still 
holds without assuming £(•) to be non-increasing. 

By contrast, for the case e(-) € L^, each trajectory of {SDC)e weakly converges to some point in argmin\I> (which 
depends on the trajectory), a result which is in the line of Bruck theorem. This is ususally referred to as the fast 
parametrization case. 

Among the many papers devoted to {SDC)e and related systems, let us mention [5], [22], [E], [16] . In [6] and [17] 

the authors show similar properties concerning the second order system 

{HBFC) x{t) + -fx(t) + V^{x{t)) + e{t)x{t) = 

with 7 > 0. 

Let us now return to the connection with {MAG). As we shall see, the {MAG) system studied in this paper leads 
to an equivalent {MAG)^ system with a corresponding control e(-) which automatically satisfies 

e{-)iL\ 

The strong convergence of the trajectories of {MAG) with 

^{x) = \\\xf 

and hence of {SDG)e, is a consequence of the strongly monotone case given by Theorem 12.21 When $ is not strongly 
monotone, the techniques of the preceding papers remain useless! Indeed, the study of {MAG) makes the situation 
clearer, and, for general $ and allows to find conditions permitting to obtain (weak) convergence to a point in 
S = argmin{<I>|argmin\E'} . This is exactly condition {Hi), which, in terms of the function e(-) for the system {MAG)e, 
in classical cases, can be seen as an integrability condition. For example, if ^'(•) = ^dist^{.,G), the condition will 
turn to be exactly 

e(-) e and e(-) ^ L\ 

Let us now state precisely the equivalence between the formulations {MAG) and {MAG)e, and also between {MAMI) 
and {MAMI)^. 

Lemma 4.1 (dictionary). Let Tfj and be two elements in (M+ \ {0}) U -l-oo. Take two functions of class G^ 

f3:[0,Tp) ^ M+\{0}; 
£:[0,T,) ^ M+\{0}. 

Define tp : [0,Te) ^ [0, T^) and t, : [0,Tp) ^ [0,T,) by 

tf,{t) ,t,(t) 

P{s)ds — t and j e{s)ds = t. 

Jo 

Assume that, for every t, 







s{t)f3{t(,{t)) 
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Then 

t^otfj^ id[o,T,) and ^ (3; 

Jo 

tfjote = id[o,T^) and Tp ^ e; 

Jo 

if X is a strong solution of 

(MAG) x{t) + + f3{t)d^ix{t)) 3 0, 

then X otfj is a strong solution of 

{MAG)e wit) + e{t)d<i>{w{t)) + 3 0; 

conversely, if w is a strong solution of (MAG),;, then w o t^ is a strong solution of [MAG). 
Now, if X is a strong solution of 

(MAMI) xit) + A{x{t)) + (3{t)d'i'{x{t)) 3 0, 

then X o tf} is a strong solution of 

[MAMI)^ w{t) + e{t)A{w{t)) + 3 0; 

conversely, if w is a strong solution of (MAMI)^, then w ot^ is a strong solution of {MAMI). 

Proof of Lemma mU Since /J"^*^ I3{s)ds = t, then tp{-) is of class G^ and ip{t)l3{tp{t)) = 1. Thus = e{t), 

and tp{te{t)) — /q'^*'' e{s)ds — t. We are now prepared to make the change of variable associated with function tf3{-). 
Let x{-) be a strong solution of (MAG) and write the system (MAG) at the point tpit): 

x{tp{i)) + d^{x{tp{t))) + I3{tp{t))d-^{x{tp{t))) 3 0. 

After multiplication by ip{t) we get 

i0{t)x{tf3{t)) +i0{t)d'^{x{tp{t))) +ip{t)l3{tp{t))d^{x{t0{t))) 3 0. 

Set w = X o tp. The map w — x o tp is absolutely continuous, and according to w{t) — tp{t)x{tp{t)), tp{t) = e{t) and 
ip{t)(3{tp{t)) = 1, we obtain 

w{t) + e(t)d'i>{w(t)) + 3 0, 

that's {MAG)e- The notion of strong solution, as given in Section [31 remains valid. Similar arguments work with 
(MAMI). □ 

Accordingly, all our results can be written for the systems (MAG)e and (AIAAII)^ . Before doing so, let us analyse 
the corresponding assumption (TCi). 

Remark 4.1. About Assumption (Tii). Take /?(•) and e(-) as in Lemma l4.ll with Tp ~ — +oo. Then, by making 
the change of variable t — tp{s) in the following integral, and by using ip{t)/3{tp{t)) — 1, we obtain 

r*'(*"fe)--(M))^' ^ r'"<''*''''K*'fe)--(«4))))^- 

■i>*{e{s)p) ~ ac{e{s)p)ds. 



Thus condition (Tii) becomes 

r + oo 

Mp e R{Nc) / - ac{e{t)p)dt < +oo. 

Jq 

In particular, when '^{x) = ^dist'^{x, C), then 'i>*{x) — |||a;p + (Jci^) and 

(Hi) / -TTT^dt < +00 / e{t)'^dt < +oo. □ 
Jo Pv-) Jo 

Theorem 4.1. Let $ and ^E" satisfy the assumptions of Theorem \3.1\ Let us assume that, 

r+oo 

• (Wi), Vp e R{Nc), / «'*(e(t)p) - acieit)p)dt < +oo. 



H-oo 

• (^2)^ e(-) is a non increasing function of class , such that limt^+00 e(i) = 0, / e{t)dt — +00, and for 
some fc > 0, —ke^ < i. 



MULTISCALED GRADIENT DYNAMICS 



15 



Let x{-) he a strong solution of {MAG)^. The 



(i) weak convergence Bxqo ^ S ~ argmin{(^\argmin^!} , w — lim xit) = Xoo', 

t — *+oo 

(m) minimizing properties lim "^{x{t)) = 0; 

t — >+oo 



lim $(a;(t)) = min $ | ^^^^ ; 



t—*-\-oo 

(Hi) yz ^ S lim \\x{t) — z\\ exists 

(iv) estimations lim ——'^{x(t)) = 0; 

i^+oo e{t) 

-i-oc 

'i>{x{t))dt < +00; 



lim sup ^ e{t) - min$|^^^^j^^) dt < 



-00. 



Proof of Theorem 14.11 Equivalence between Theorem 14.11 and Theorem 13.11 is a consequence of Lemma 14.11 
Remark 14.11 and the equivalent formulation of condition (7^2) as given below: 
Write (H2) at the point i/3(t) 

P{tf,{t)) < mtp{t)) 

and multiply by tfj{t) (which is nonnegative) 

^{tp{t))tp{t) < k(3{tp{t))tp{t). 

Owing to (3{tp{t))tfj{t) = 1, we get 



which, by using e{t)[3{tj3{t)) = 1, finally yields 



dt \eit) J e^{t) 
that's (^2)^. □ 

5. Further convergence results, without the growth condition (3 < kp 

It worth noticing that, in the proof of weak convergence theorem 13. 1[ the growth condition fi < k[3 is only used 
ultimately, in lemma [331 It allows to develop an energetic argument involving £2- As a byproduct of this technic, one 
obtains too that the trajectories have finite kinetic energy: /q''°° < +cxd. It is a natural question to ask whether 

theorem 13. II still holds without this growth condition. As a positive answer, when H is a finite dimensional space, we 
are going to prove that convergence of the trajectories holds true without this growth condition. Indeed, having in 
view applications to possibly infinite dimensional problems (PDE's, control), we consider the more general situation 
with functionals (f> or ^E* which are supposed to be inf-compact. Let us recall that a function <^ : H — > M U {+c»} is 
said to be inf-compact if, for every i? > and I £ M the lower level set 

{x £ H : \x\ < R, (j){x) < 1} is relatively compact in TC. 

Our proof is close to Baillon-Coniinetti argument developed in [11| theorem 2.1. It relies mainly on topological 
arguments. It turns out that it is more convenient to work with the {MAG)^ version of our dynamics (see section 4) 

(MAG)^ x{t) + d-^ixit)) + e{t)d^{x{t)) 3 0, 

with a positive control t 1— > e(t) that converges to as i — s- 00. Then, the result can be easily converted in terms of 
(MAG). 

Theorem 5.1. Let $ and ^ satisfy the assumptions of Theorem \3.1\ Let us assume that, 

p+oo 

• (Hi), Vp e R{Nc), / **(e(t)p) - acieit)p)dt < +00. 

r+ca 

• ("^2), £(•) is a non increasing function of class , such that linit^+oo e{t) — 0, e{t)dt = +00. 



(7^3) ^ or is inf-compact and S is bounded. 
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Let x{-) he a trajectory solution of [MAG)^. Then the following convergence result holds 

~^Xoo G 5* = argmin{'^\argmin'^} , lim x{t) — x^o 

t — > + CxD 

the convergence being taken in the strong sense when ^ is inf- compact and in the weak sense when $ is inf- compact. 

Proof of Theorem 15.11 In view of Lemma I4.1[ one can easily check that the assumptions of Theorem 13.11 are 
satisfied, except for the growth condition —ke^ < i / (3 < k(3. So aU the results in the proof of Theorem 13.11 hold, 
except for Lemma 13.51 

Weak convergence of the trajectories. We know that, for every z in 5 = argmin{$|argmin5'}, limf^+oo W^i^) ~ A\ 
exists (Lemma 13. ip . In order to obtain weak convergence of the trajectory we use Opial lemma. Thus, we just need 
to prove that every weak-limit point of x(-) belongs to S. In turn, this will be a straight consequence of 

(18) dist{x{t),S) -^i) as t ^ +oo 

and of the weak lower semicontinuity of the convex continous function dist{-, S). In order to prove (jlSp let us introduce 
h{t) :— ic?isf(x(t), S")^, and estimate /i(t). SetDs{x) = i(iisi(a;, S*)^, which is convex and differentiable with VD5'(x) = 
X — Ps{x), where Ps is the projection of x onto S. Then for almost every t, 

(19) h{t) = {x{t),x{t)~Psx{t)). 
Let us rewrite {MAG)e as 

(20) x{t) + e{t)d<j>t{x{t)) 3 
with 

e{t) 

For almost every t, by using (|19|). ([20|) and convexity of <j>t 

hit) = sit)(dMx{t)),Psx{t)^x{t)) 
< e{t){MPsx{t))-M^m- 

Let us notice that (j>t{Psx{t)) is independent of t (recall that 5* = on S). It is equal to the optimal value of the limit 
equilibrium problem, we set 

Vopt '■= ^{z) for all z G S* = argniin{$|argmin^'}. 

Hence, 

h{t)+e{t) {Mx{t)) - vopt) <0. 
Integrating, and using that the function h is bounded, we get 

e(t) (0t(a;(t)) - Vopt) dt < +00, 



and since /g^°° e{t)dt = +00 we deduce that 

liminf ((/)t(a;(<)) - iw) < 0. 

t— »+oo 

By definition of liminf, this implies the existence of a sequence tk +00 such that liirik^^aa 4'tk{^{tk)) < Vopt- 
From boundedness of the trajectory x{-) and inf-compactness assumption {Hs), we deduce that the sequence {x{tk)) 
is relatively compact in Ti.. On the other hand, as < ^ +cxd, the sequence of functions 4>t converges increasingly to 
$ + (5c where C = argmin\E'. By a classical result, monotone convergence implies epiconvergence (F-convergence) (see 
[1] theorem 2.40) with its accompanying variational properties. Still denoting x{tk) a subsequence which converges to 
some Xoo, we obtain that Xqo G argmin{$ + Sc} — S . From 

h{tk) = ^dist{x{tk), Sf < ^\x{tk) - XooP, 

we obtain the convergence of h{tk) to zero. Thus, we have established the existence of a sequence tk —>■ +00 such that 
h{tk) tends to zero. The proof will be completed by proving that hmt_+_|_oo h{t) exists. Let us return to ([5]), introduce 
the set 

St := {x : (f>t{x) > Vopt} 



and observe that 



x{t) eSt^ hit) < 0. 



Set 

(21) b{t) := sup{Ds{x) : M^) < Vopt}- 

Thus, 



Ds{x) >b{t) ^xeS; 
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and 

h{t) = Dsix{t)) > b{t) =^ x{t) eSt^ h{t) < 0. 
Let us show that hm(^-|_oo^(0 = 0, with b{t) defined in (|21l) . Let us argue by contradiction and suppose that there 
exists £ > 0, tfe — > +0O, and e 7i with ipt^ (xk) < Vopt and dist{xk, S) > e. By convex combination of Xk with Ps{xk) 
we can assume, without loss of generahty, that dist{xk, S) = e. The set S has been assumed to be bounded. It follows 
that the sequence {xk) is bounded. From the inf-compactness assumption (Ha) and (jit^ixk) < Vopt we deduce that 
the sequence (xk) is relatively compact. Thus, passing to a subsequence, we can assume that xu strongly converges to 
some X. From (ptki^k) < Vopt and the preceding epi-convergent argument we get x € S. This clearly contradicts the 
fact that dist{xk, S) = e and Xk strongly converges to x. 

Collecting the preceding results, we are in position to apply the following lemma to obtain that limj^+oo h{t) exists, 
and hence conclude to the weak convergence. We give the proof of the lemma for the convenience of the reader. 

Lemma 5.1. lemma 2.2) Let h{-) and b{-) be two real-valued functions defined on (0, +oo) with h{-) absolutely 

continuous and nonnegative. Let us assume 

• (i) b[t) — > as t —t +oo; 

• (ii) there exist a set N C (0, +oo) of zero Lebesgue measure such that h{t) > b{t) =^ h[t) < for all t ^ N . 
Then h(t) has a limit for t +oo. 

Proof of Lemma 15.11 Replacing b{t) by sup{fe(s) : s > i}, we can assume, without loss of generality, that is 
nonincreasing. Since by assumption /i(-) is nonincreasing when above 6(-), it follows easily that, if h{s) < b(s) for a 
given s > 0, then h{t) < b{s) for all t > s. 

Let us examine the two situations: Either there exists some s with h{t) > b{t) for all t > s, then h{-) is nonincreasing 
over [s, +oo) and therefore it converges when t — ^ +oo. Or there exists a sequence Sk +oo such that h{sk) < b{sk) 
for all A; G N. By using the above remark, we deduce < h{t) < b{sk) for all t > Sk- Since b{sk) 0, we conclude 
that h{t) -^Oast^ +oo. □ 

Strong convergence when ^' is inf-compact. Since the trajectory x{-) is bounded, and since ^!{x{t)) 0, we conclude 
that the trajectory x{-) is relatively compact. It weakly converges, thus strongly converges. □ 

6. Applications 

We first show how our study fits coupled gradient dynamics; then, we consider two particular situations, firstly 
domain decomposition for elliptic PDE's, secondly best response dynamic approach to Nash equilibria for potential 
games. 

6.1. Coupled gradient dynamics. Throughout this section we make the following assumptions: 

• ?{ = Xi X X2 is the cartesian product of two Hilbert spaces, set x = {xi,X2); 

• ^{x) = fi{xi) + f2{x2) + 4'{xitX2), fi G To{Xi), f2 & ^o{X2) are closed convex functions, ip : Xi x X2 M. 
is a smooth convex coupling function; 

• ^{x) = ^||^i2;i — L2X2\\%, Li G L{Xi,Z) and L2 G L(A2,Z) are linear continuous operators acting respec- 
tively from Xi and X2 into a third Hilbert space Z; 

• j3 : R"*" — > R"*" is a function of t which tends to +00 as t goes to +00. 
In this setting, {MAG) system 

x{t) + d^{x{t)) + (i{t)d'^{x{t)) B 

becomes 



xiit)+dfi{xi{t)) + V^,(f>ixiit),x2it))+P{t)Ll{Lixiit) - L2X2{t)) 9 



(22) 



X2{t) + df2{x2{t)) +V ^,(l){xi{t),X2{t)) + (3{t)Ll{L2X2{t) - LiXi{t)) 3 0. 

Because of the quadratic property of ^, condition (Tii) can be equivalently written 
As a straight application of theorem 13. li assuming (Tii) and the growth condition 

we obtain that x{t) = {xi{t),X2it)) Xoo = (2^1, 00, 2:2,00) weakly in Ti where (xi_oo, 2:2,00) is a solution of 



(23) min{/i(a:i) + /2(x2) + 0(2:1, 0:2) : LiXi - L2X2 = 0} . 

In theorems 12.21 and 1 5 . 1 1 we describe several situations where similar conclusions hold without condition $ < k/3. 
Structured optimization problems (|23p occur in various domains: 
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• In game theory (see subsection 6.3 for further details), describes Nash equihbria of the potential game 
(here team game) with two players 1, 2 and respective static loss functions: 

{Fi : {xi,X2) € Xi X X2 ^ Fi{xi,X2) — fi{xi) + (j>{xi,X2) if LiXi — L2X2 = 0, + 00 elsewhere 
F2 : ixi,X2) e Xi X X2 F2{xi,X2) = f2ix2) + (f>ixi,X2) if Lixi - L2X2 = 0, + CO elsewhere. 

The fi{.) represent the individual payoffs of the players, 0(., .) is their joint payoff, and LiXi — L2X2 = is a 
constraint expressing, in a normalized form, global limitation of the resources. In that case, a discrete version 
of system ([22|) provides a best response dynamic approach to such equilibria. 

• In optimal control theory, the constraint {LiXi — L2X2} is the state equation, which relates the state variable 

Xi to the corresponding control X2 ■ In that case, the criteria which is to minimize naturally splits into the 
sum of two costs: the cost to be far from a desired state and the cost of the control. 

• Variational formulation of phase transition, cracks and fissures, image segmentation and many others naturally 
lead to minimization problems of type l|23|) . Here, functions fi represent the internal energy of the different 
phases, while coupling terms represent energies located at the interfaces, as well as some transmission con- 
ditions. Indeed, for numerical purpose, it is also interesting to relax the classical variational formulation of 
elliptic boundary value problems into the form (I23|l in order to perform decomposition of domains methods 
(see section 6.1 below). 

An important question is the modelling of dynamic approach to such equilibria, and the design of iterative numerical 
schemes (algorithms) for solving the corresponding problems. Both concern asymptotic behavior of associated discrete 
dynamical systems. Indeed, as a general rule, continuous versions of these systems offer flexible tools allowing a 
deeper understanding of their mathematical properties. Moreover, they may suggest extensions and connections with 
other domains. Let us illustrate this with two applications in different domains: one concerns domain decomposition 
methods for PDE's, and the other best response dynamics in potential games. 

6.2. Domain decomposition for PDE's. In the following example, the domain naturally splits into two elemen- 
tary non overlapping subdomains fli (i=l,2) with common interface F, i.e., i7 = fJi U il2 U F. 



fii F 




n2 





Given h G L^(r2), Dirichlet problem on consists finding u : f2 ^ M solution of 

{—Au — h on n 
u — on dfl. 

Its variational formulation can be equivalently formulated as 

minji /" |Vwip-/ hvi + l- [ |Vu2p - / hv2 : v ^ on dil, H=0 oufI 

where v — Vi on Qi and [v] is the jump of v through the interface F. 
Indeed, the above problem falls into the setting of (with = 0) 

min{/i(t;i) -|- /2(w2) : Vi G Xi,V2 G X2, Li{vi) - L2{v2) = 0} 

by taking 

• X,^ {v € H^{ni) : V on dVtr\dni}, w = on f]^, i = 1, 2. 

• Li : H^{Vli) Z = L^iT) the Sobolev trace operator, i = 1, 2. 

• [v\ = Li{vi) — ^2(^2) = jump of V through the interface F. 

Let us equip Xi = {v & H^{Ui) : v = on dil. H dfti} with the scalar product {u,v) = Vu.Vv. By Poincare 
inequality, the induced norm is equivalent to the usual norm of H^lfli). Then, ([^ reads as follows 
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' -A^ - Aui = hi on Qi 



^ + ^{t)-P{t)[u{t)]=0 OUT 



du2{t) 



+ ^it) + mHt)] = o onr 



A standard implicit discretization scheme leads to the following alternating algorithm with Dirichlet-Neumann trans- 
mission conditions: 

(wi,fc,U2,fe) {ui,k+i,U2,k) (ui,fe+i,U2,fc+i) with Pk +00; 

— (1 + a)Aui^k+i = hi — aAui^k on fli 
(l + a)%fi+/3fcui^fc+i =/3fcU2,fc+a^ on T 

wi,fc+i — on dfli n dfl 

— (1 + Q;)Au2,fc+i = h2 — aAu2,k on il2 



{l + a)^^^+PkU2. 



U2,k+i = on dil.2 n dQ 

In the above algorithm, one has to solve boundary value problems alternatively on fli and Q2- Thus the initial 
problem has been decomposed into more elementary subproblems. This approach can be advantageously combined 
with Lagrangian technics, parallel computing methods and fits well constraints on the data as well as unilateral 
transmission conditions, as long as convexity properties are satisfied, see [8] and reference herein. 

6.3. Best response dynamics for potential games. Consider the potential game (here team game) with two 
players 1 and 2 whose respective static loss functions are given by 

Fi : {xi,X2) ^ Xi X X2 ^ Fi{i,X2) — fi{xi) + (l){xi,X2) if ^1X1—^2X2 = 0, + cx) elsewhere 
F2 : {xi,X2) E Xi X X2 ^ F2{xi,X2) — h{x2) + (j){xi,X2) if Lixi ~ L2X2 = 0, +00 elsewhere. 



on r 



Because of the particular structure (the joint payoff 0(-, •) of the two players is the same), the Nash equilibria are the 
solutions of the convex constrained minimization problem 

min{/i(a:i) + /2(x2) + 4>{xi,X2) : ii^i - L2X2 = 0} . 
The constraint LiXi — L2X2 — reflects some limitation on the global resources of the agents. 

A central question in game theory, decision sciences and economics is to describe realistic dynamics which converge to 
such equilibria. In this context, the corresponding (MAG) dynamic 

J xi{t) + dh{xi{t)) + \/,,(j){xi{t),X2{t)) + l3{t)Ll{LiXi{t) - L2X2{t)) 3 

\ X2{t) + df2{x2{t)) + V^,(l){xi{t),X2{t)) + l3{t)L*2{L2X2{t) - LiXi{t)) 3 

provides a valuable guideline. Indeed, discretization of this continuous dynamics leads to the following "Best reply 
dynamic with cost to change" , (players 1 and 2 play alternatively) 

ixi,k,X2,k) {xi^k+iiX2,k) ixi,k+i,X2,k+i) with I3k +00; 
viM+1 ^ argmm{fi{0 + (f>{^,X2,k) + %-\\Li^ ~ L2X2,k\\^ + ^ U - xi^k \\%,: C e Xi} 



X2,k+i = argmin{/2(77) + (j){xi^k+i,r]) + %||iiXi,fe+i - L2??|| 



I \\v~X2,k fx,: V&X2}. 



For the cognitive and psychological interpretation of the costs to move terms || ^ — xi^k H^'i ^^'^ W V ~ X2,k Wx^ consult 
[2], [1], [2]- The parameter Pk traducts some adaptive behavior of the agents, with endogenous and/or exogenous 
aspects. This discrete dynamic provides an elementary model for "how to learn sharing limited resources". 
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